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MEMORANDUM FOR THE RECORD 

SUBJECT: INTELLIGENCE SUCCESSES AND FAILURES 


25X1 


25X1 


I have been engaged in the following activities, in response to 
the DCI's request that analysts be exposed to the lessons from 
the CIA record regarding intelligence successes and failures. 


I have been teaching a two-hour unit on the subject to a large 
number of analysts -- mostly new hires. I have presented the 
unit to the New Analysts Course and to the Analysis Training 
Course. I have also been presenting it to all DO Career 
Trainees. The unit was also presented to the Military 
Analysis Course and I will soon present it to new branch 
chiefs (Introduction to Supervision). 


This effort, in my view, has worked well in sensitizing the 
students to the challenge of intelligence analysis, the 
pitfalls, and the need to take seriously the recommendations 
of the DCI and the DDI for improved analysis (such as 
challenging assumptions and projecting multiple outcomes). 


I am also prepared to present a short version of the course to 
interested special groups. For example, I will present a 
three-ho ur version to the staff of the Operations Center 


at their 


Conference 


The first running of the 6-day course for analysts is now at 
its midpoint. The syllabus and the annotated reading lists 
are attached. 


The first course has 18 students: 15 from the DI , 1 from 

NIC/AG, 1 from DDST/ORD, and 1 from 0/DCI (Historical Staff). 

The student response so far -- as I judge it and as judged 
by OTE colleagues who have sat in on individual sessions -- 
has been quite positive. After two days of discussion on 
the general caus es of failure (including a presentation by 

| based on the recent SRP study for the DCI) , 
the students presented their case studies on failure. 

Task groups of 3 students each presented to the class 

what they think caused the failure in Cuba in 1962, the Middle 

East War of 1973, and Iran, 1978-79. 
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Their presentations were based on readings for the course, 
including selections from post mortems, and on interviews’ 
with participants in the failure. O n Iran, for example, 
the students interviewed] I th e responsible OPA 

Division Chief at the time, | \ Chief of the Iran 

Analytical Center, and John Helgerson, then the Assistant 
NIO. ' ~ 


The student presentations generally confirmed the previous 
class discussions on the causes of failure. Nonetheless, 
the students engaged in the case studies reported that 
they had gained a sharper appreciation of the problems 
facing the analysts than they could have gotten from 
my lectures and class discussion on problems in general. 

The students now understand that failure does not happen 
only to the other analyst. And I think they now are ready 
to take seriously the second half of the course -- a 
cost-benefit analysis of DCI and DDI recommendations for 
improved analysis. 

To supplement this discussion, selected students will 
present their findings on "successes" in the work of 
their own Offices, or from the general record. Among 
the topics chosen are the Andropov succession and 
Nicaraguan export of revolution. 

Though it is too early to reach a judgment on the course 
overall (do the students change enough to justify six 
days away from their desk?), the remark from several 
of them that their Branch and Division Chiefs should 
take the cou rse is a promising sign. 


c? 

20 March 1984 


25X1 

25X1 
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INTELLIGENCE SUCCESSES AND FAILURES 


Presented by 

Analysis Training Branch 
Intelligence Training 
Office of Training and Education 


Course Director 


STAT | 

Analysis Training Branch 

OTE Course Instructor 


STAT | 

Analysis Training Branch 
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INTELLIGENCE SUCCESSES AND FAILURES 
COURSE SCHEDULE 


DAY UNIT 


TIME 


1 . 


1 . 
2 . 
3. 

5. 


Introduction 
CIA Record 

Interpretations of Intelligence Failure 

th ? Interna tional Environment 
Case Study Assignments 


0900-1030 

1040-1200 

1300-1415 

1425-1550 

1600-1650 


2 . 


6 . 

7. 

8 . 

9. 


Political and Organizational 
Analyst-Generated Barriers I 
Analyst-Generated Barriers II 
Senior Review Panel: Causes 


Barriers 


of Failure 


0900-1030 

1040-1200 

1315-1450 

1500-1630 


10. Case Studies of Failure I 

11. Case Studies of Failure II 

12. Summary on Causes of Failure 


0900-1150 
1300-1450 
1 500- 1 630 


4. 


13. 

14 . 


15. 

16 . 


Coping with International Barriers 
Analytical Techniques for Dealing with 
Complexity 6 

Coping with Deception 
Product Evaluation Staff: 

Requirements for Success 


1? * Barrifrs ith Political & Organizational 

18. The Analyst’s Responsibility: Lateral 

Growth 

19. The Analyst’s Responsibility: 
Openmindedness 

20. The Analyst’s Responsibility: 
Relationships 


0900-1015 

1020-1200 

1315-1450 

1500-1630 

0900-1030 

1040-1200 

1300-1430 

1440-1630 


21 . Case Studies of Success I 

22. Case Studies of Success II 

23. Conclusions & Student Evaluations 


0900-1 150 
1300-1430 
1440-1630 
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INTELLIGENCE SUCCESSES AND FAILURES (ISF) 
INSTRUCTIONAL UNITS 


1 . Introduction . DCI , DDI , and ATB purposes in sponsoring 
ISF. Review of course objectives. Student introductions and 
objectives in taking the course. Ground rules. Definition of 
terms frequently used in course. 


2. The CIA Record: Perils of Estimating . Where CIA has 

generally done well, and where poorly. Why we have had most 
failures in anticipating military threats, third world 
revolutions, and sharp policy shifts. The perils of 
estimating: being wise is not always sufficient for being 

right. Comparison of the overall CIA record with that of other 
intelligence services, and the performance of other groups in the 
US (economists, Wall Street and sports "handicappers ," academic, 
and journalists). 


3 . Interpretations of Intellignece Failure . Critical 
explanations from the reading material. Student views. Concept 
of multiple barriers to correct interpretation of "signals” of an 
on-coming crisis or important event (See chart next page). 


4 . Barriers in the International Environment . "Noise " 
(event and data overload). Complexity (the difficulty of 
estimating an adversary’s moves before he closes his options). 
Paradox of Warning (Japan would not have attacked on 7 December 
1941 if it had perceived US alert). Cultural Differences 
(thinking like the Politboro). Paradox of Risk (the more 
outrageous a risk, the less likely it will be anticipated, the 
less risky it becomes — as in the missile crisis of 1962 ). 
Deception (the key to surprise attack). Student examples from 
their current analytical assignments. 


5 . Case Study Assignments . The students will select 
prominent cases of intelligence success or failure (e.g., the 
Iran Revolution) to study (readings and interviews) and explain 
to the class (see Instructional Units 10-11, 21-22). 
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Signal Barriers Generated By: 


INTERNATIONAL 

ENVIRONMENT 


* complexity of would affairs 

* national cultural differences 
*multiple actors [surr ogates) 


POLICYMAKING 

ENVIRONMENT 

+mis perception cl adversaries 

* policy momentum 

+wishful thinking ["aan-doism") 


ORGANIZATIONAL 

ENVIRONMENT 

* resource limitations 

*emphasis on current reporting £ 
building -block res torch 



Signal B arriers Generated By: 


INTERNATIONAL 

ENVIRONMENT 

* noise [data i event over load) 
*deception f concealment 
* propaganda 


POLICYMAKING 

ENVIRONMENT 

+ bureaucratic competition: 
threat inflation/ deflation; 
non-sharing of information 


ORGANIZATIONAL 

ENVIRONMENT 

Hrixed management signals 
[take risks vs. play Safe) 

*turf battles [resistance to 
[coordination £ off-line units) 


ANALYTICAL 

ENVIRONMENT 

* arrogance /timidity in estimating 

* resistance to critical review 

£ serious coordination 

* substantive overspecialization 

* overemphasis on in-box 

* denigration oi policymakers 
£ other non-analysts 


ANALYTICAL 

ENVIRONMENT 

* biases [mirror imaging) 

*prejudice towards: 
continuity of trends; 
confirming evidence 

* res is lance to structured 
analytical methods 

*skiUs limitations [ writing ! 



Barriers are defined as obstacles to correct .interpretation of signals of 
developments of importance to US interests [threats and opportunities) . 
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6. Political and Organizational Barriers, . Explanations 
from the reading material. Historical examples. Student 
explanations and examples. Political and organizational barriers 
in perspective: To what extent do the problems for intelligence 

analysts (e.g. partisan and bureaucratic competition, unclear 
management signals) flow from the inherent character and strength 
of the US political system and of large organizations. 


7. Analyst-generated Barriers I. DCI and DDI . 

Explanations from the reading material. Arrogance , and Timidit y 
(some analysts are too quick to reach judgments; some, too 
slow). Biases (we cannot operate without analytical frameworks 
to simplify "reality , but even the best . frameworks do not 
represent reality). Paradox of Expertise (in general, the expert 
on nuances of a foreign country is handicapped in anticipating 
’'uncharacteristic'' behavior and therefore "sharp changes). The 
"Lone Ranger" syndrome (negative analyst attitudes toward 
critical review, meaningful coordination, and alternative views 
of non- analysts). Skill limitations (especially writing, as an 
obstacle to integrating useful criticism and handling less like y 
alternatives). Student responses. 


8. Analyst-generated Barriers II . Above discussion 
continued. 


9 . Senior Review 
Intelligence Failure. 
lecturer. 


Panel Group Views on Causes of 
I “I SRP , guest 


10 . Case Studies on Failure JL 
in which case studies validate or 
class discussion on general causes 


. Students will discuss ways 
require redefinition of prior 
of failure. 


H. Case Studies on Failure II. Procedure same as in number 


10 . 


12. Summ ary on Causes of Failure . Students to relate their 
current views on the causes of failure to their present and 
prospective DI assignments: What are the most important barriers 

thev P face? Does intelligence failure happen only to the other 
analyst? Who has responsibility to overcome obstacles? General 

discussion on how . 


with Barriers in the International 


13 . Coping _ _ — — — — ^ - 

Understanding and adjusting to the limitations to 
analysis: projection of multiple outcomes; using 

(collectors, methodologists, warning specialists;. 


System . 
intelligence 
the system 


STAT 
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I 

t 

STAT 


1*1. Analytical techniques for Dealing with Complexity . 

\ ~. Distinguishing types of problems. Survey 
or analytical techniques. 


15. Coping with Deception . ( . Why and 

how deception succeeds. What the country analyst can contribute 
to the efforts of the warning specialists, to improve the record 
of countering deception. Political and military dimensions. 


STAT 


1 6 . Product Evaluation Staff views on the Requirements for 
Intelligence Success . Helene Boatner, Chief PES, guest lecturer. 


17. Coping with Political and Organizational Barriers . 

(A) Understanding the policymakers' modus operandi (empathy, role 
playing, contact). (B) The need for and the special challenge of 
"customized” analysis. (C) Brief history of intelligence 
organizations: Does structure matter? (D) Recent CIA changes 

(regional organization, Alert Memoranda, NIO warning Meetings). 
(E) Possible lessons from the corporate world (In Search of 
Excellence) . 


18 . The Analyst's Responsibility: Lateral Growth . The 

cognitive and analytical processes. "Quotations" (analytical 
building blocks). The importance of writing and briefing skills. 


19* The Analyst's Responsibility: Openmindedness . What 

does it mean, and how can it be implemented? Cost-benefit 
analysis of techniques such as "devil's advocacy," "role playing 
the adversary," and emphasis on disproving rather than confirming 
judgments. Projecting alternative outcomes. Communicating 
levels of confidence. Drawing policy implications. 


20. The Analyst's Responsibility: Strengthening 

Relationships . With substantive peers throughout the Agency and 
Community, with policymakers, with outside experts. Cost-benefit 
analysis of taking seriously divergent points of view, including 
those of "worst casers" and "best casers". The art of making 
reviewers, coordinators, and critics work for you. Why the 
consumer is "king.". 


21 • Case Studies of Succes I . Student task groups will work 
to refine class discussion on requirements for success. 
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22. Case Studies of Success II . Procedures the same as in 
no. 21. 

23. Conclusion and Student Evaluations . What have we 

learned? Where and why do students agree (disagree) with 
critics? With instructor? What should be done; what can be 
done: by the analyst, by DI management, through training and 

education. Student evaluation of the course. 
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STAT 


INTELLIGENCE SUCCESSES 
READING SELECTIONS: 


& FAILURES: 
VOLUME I 


—-NOTE ON THE READING SELF. flTT QNS 


classified volume will 1 piace n a t largI° 1Um rt ^ in the com P ani °c 
demand on the students. Nonethelefs’ e^oh^i ^ unrealis tic, 
represents a point of vipu nn ? ch sele ction either 

coming to grips ^ 

successes and failures. S ^uDject or intelligence 

artioie e ryou S Lueve n ^n at be o?iosf C ? ntents t0 the 

understanding of the sub ieet and lue ln stren Sthening your 

problems. Please v „ component issues and 

preparation for the first day of th^oo^se? 0 TabS F and 0 ln 

repreIent t an n endo?sement°of the aeIuroor*f “itl " ot . nenessarily 
soundness of its judgments At ??mo« y f ts facts or the 
another on the issue or problem undlr ’ discussion! 6 contradicts 


TABLE OF CONTENTS 


tab a. course syllabus, objectives, and instructional units 
definition of frequently-used terms. 

STUDENT EVALUATION FORM. 


TAB B * ^- RIEFS ON THE PROBLEMS AND PERILS OF ANALYSTS 


TAB C. BRIEFS ON THE CIA RECORD 
(Willi am »J . Casey ,\^ 


TAB D 


] 


THE RECORD ACCORDING TO THE PIKE COMMITTEE (1976) 


A convenient and informative, if 
review of a series of failures. 


not always balanced, 


TAB E. 


W.D. HOWELLS, "INTELLIGENCE CRISES" (1983) 


A defense 
criticized 


of intelligence analysts and 
practices by an INR veteran 


of some frequently- 
practitioner . 


STA 
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NO FOREIGN DISSEMINATION 


25X1 


INTELLIGENCE SUCCESSES AND FAILURES 
READING SELECTIONS: VOLUME II 


TABLE OF CONTENTS 


( 

STAT 


STAT 

STAT 


c 


TAB N. REFLECTIONS ON THE CIA RECORD 

WILLARD MATTHIAS, "HOW THREE ■ ESTIMATHR-WfiKT-WRONGi “ — 
STUDIES IN INTELLIGENCE, 12:1 (WINTER 1968). 


| ON ESTIMATING THE SOVIET STRATEGIC THREAT 

( 1982 ) . 

HOWARD STOERTZ, ON THE SOVIET STRATEGIC THREAT (1982). 



articles are indirect responses to 


the 

article in Volume I 

25X1 


TAB 0 CASE STUDY ON THE CUBAN MISSILE CRISIS, 1962. 

SNIE 85-3-62: THE MILITARY BUILDUP IN CUBA. 

SHERMAN KENT, "A CRUCIAL ESTIMATE RELIVED” (1964). 

A defense of the analytical process that underlay the 
estimate . 

THE CUBAN MISSILE CRISIS: TWO VIEWS OF THE EVIDENCE 

(1964). 

TAB P. CASE STUDY ON THE 1973 MIDDLE EAST WAR 

RICHARD KERR, INFORMAL NOTE ON THE 1973 MIDDLE EAST WAR. 
A participant on the problem of conflicting evidence. 
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NO FOREIGN DISSEMINATION 
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STAT 

r 


TAB Q. CASE STUDY ON IRANIAN REVOLUTION, 1978-79 

EXCERPTS FROM THE OFFICIAL POSTMORTEM. 

I I academic specialist on misperception 

(Volume I, Tab F), was the principal author. Probably 
the most authoritative postmortem, with insights into 
the difficulty of anticipating and monitoring a 
revolution . 

TAB R. DEALING WITH POLITICAL BARRIERS 

ROBERT GATES, "AN OPPORTUNITY UNFULFILLED: THE USE AND 
PERCEPTIONS OF INTELLIGENCE ANALYSIS IN THE WHITE HOUSE 
( 1980 ) . 

On overcoming isolation (ours) and suspicion (theirs). 

"ON ESTIMATING REACTIONS" (1965). 


An old artform that reduces the barrier between 
intelligence and policymaking after a given policy 
course has been determined. Used frequently during the 
Vietnam War. 

TAB S. ROBERT GATES ON THE ANALYST'S RESPONSIBILITY 

"THE PREDICTION OF SOVIET INTENTIONS" (1973). 

On lateral growth, openmindedness, and other 
requirements for improved analysis 

EXCERPTS FROM DDI REMARKS 13 JANUARY 1983* 

On multiple projections and other correctives. 

EXCERTS FROM DDI NEWSLETTER, 28 JULY 1983 & 12 JANUARY 
1984. 

On relations with the policymaker, multiple projections, 
and lateral growth. 


C 
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OTE 83-6825 *' / 

24 October 1983 


MEMORANDUM FOR: 
VIA: 


FROM: 


Director of Central Intelligence 


Deputy Director of Central 
Execu t i ve Di rector 


Intel 1 i gence 


Deputy Director for Intelligence 
Deputy Director for Administration 
Director of Training and Education 


Analysis Training Branch, Office of 
Training and Education 


SUBJECT: 

REFERENCE: 


InteUigence Successes and Failures (ISF)- 
Status Report on Syllabus <5c Reading List 


Your Memorandum to the D/OTE, dated 
7 April 1982, Subject: Training 

Intelligence Analysis 


i n 


a status report^plfnT for'a cou?se S f or^anal'Js trUn^he^ 
essons of intelligence successes and I.IUki J 

srnZrjra 

pS in y°ur memorandum to Director of Training and * d 

Sr*.*K3K.sS|5a!iss: 

and G Education r (OTE)! n ^ DI *" d in the ° ffice of Trflini " ff 

e cnanges in attitudes and practices that wi i i 

^ >n 7 z / co 25X ] 
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SECRET 


SUBJECT: Intelligence Successes and Failures (ISF): 

Status Report on Syllabus A Reading List 


3. The Tentative Syllabus for Intelligence Successes 
and Failures (ISF) contains a list of specific course 
objectives and sketches out 36 hours of seminars, exercises, 
and guest speakers to illustrate the planned thrust of the 
course (Attachment A). 

4. The selection of reading materials for ISF is still 
in an early stage. The annotated preliminary list of case 
studies and commentaries by veteran practitioners and 
outside critics provides a general view of the range of 
materials under consideration for the course (Attachment B). 

5. Subject to final approval, I plan to offer the 
course in January and April 1984 — to test its effectiveness 
in achieving your objectives. In response to the DDI's 
recommendation, I am also incorporating the essence of ISF 
as a two-hour unit, in other OTE courses. This already has 
been done for the current running of the Analysis Training 
Course (DI Career Trainees), the New Analyst Course 
(recently-hired DI analysts), and Introduction to the DI (DO 
Career Trainees). Additionally, I will, in May 1984, 
prepare a memorandum for you and the DDI on the implications 
for management and training of my research findings and 
instruction^ experience regarding intelligence successes 
and failures. The final goal is to fine tune the ISF course 
and the two-hour unit for regular presentation by OTE 
starting in July 1984. 


Attachment s : 
As Stated 


DDA/OTE/IT/ATB/ 


:mrp: 


240ct83 ) 


Distribution: 

Orig - Addressee, w/atts 
1 - DDCI , w/atts 
1 - ExDir, w/atts 
1 - Exec. Reg. w/o atts 
1 - DDI , w/at ts 
1 - DDA, w/atts 
1 - D/OTE w/atts 

1 - OTE Reg. w/o atts 

2 - ATB/IT/OTE, w/att 

- 2 - 
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SUBJECT: (Optional) 


EXtENSIQl NO 


atb/it/oth 

926 C of C 





OTE 83-6825 


TO: (Officer designation, room number, and 

building) 


DATE 

RECEIVED I FORWARDEiJ 


OFFICER'S COMMENTS (Number eoch comment to show from whom 
" ' 1 “ k> whom. Draw a line across column after eoch comment,) 


D/OTE 

1026 C of C 


/0/ 


AdtingDDA 

7D18 HQ 


oc of'T 
LV 1 983 


DDI 

7E47 HQ 


7 NOV, 
■ft- 4003 


7. 

Exec. Reg. 
7E12 HQ 


8. 

9. 

Exec. Dir. 
7E12 HQ 

L^O Ci 

10. 


C 

n. 

DDCI 
7E1 2 HQ 


12. 


c 


? WO 


FORM Alfl use FREVIOU 
f 79 o I U EDITIONS 


Srfl'fvs l^epoRi; 

■V- 

£./ST 

T/Jl0 _ SxtSSSK * 

ffiitu&S Ctotse , 



V W w ’ 

6 < 

^}\ a - 


Scuntl ) 
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SUBJECT: (Optional) 
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926 C of C 


TO: (Officer designation, room number, and 


building) 


D/OTE 


1026 C of C 


AdtingDDA 


7D18 HQ 


DDI 


7E47 HQ 


Exec. Reg 


7E12 HQ 


OTE 83-6825 


FORWARDED 



r) r w 

ZO 1903 


OFFICER'S COMMENTS (Number each comment to ihow from whom 
INITIALS to whom. Drow a line across column after each comment.) 


Srfi tvs fcefvft'i 


£yitmvs, + 

fife 


Senses 

Ga * cE 


7 KOV 1983 


Exec. Dir 


7E12 HQ 




DDCI 


7E12 HQ 




7E12 HQ 


JD/o*Tc 


FORM A usc PREVIOUS 

, „ 0 I U EDITIONS 


SECntiJ 
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£^55 c 


OTE 83-6825 



24 October 1983 


MEMORANDUM FOR: 
VIA: 


FROM: 

SUBJECT: 

REFERENCE: 


Director of Central Intelligence 

Deputy Director of Central Intelligence 
Executive Director B ce 

Deputy Director for Intelligence 
eputy Director for Administration 
Director of Training and Education 


Anaiysis Training Branch, Office of 
Training and Education 

In telligenc e Successes and Failures (ISF): 
Status Report on Syllabus & Reading List 

Your Memorandum to the D/OTE. dated 
7 April 1982, Subject: Traintng^in 

Intel 1 lgence Analysi s 


1« This memorandum is in t*e«nr>ne A 
a status report on Dlan«? for * 1 your re< 3 ue s t for 

lessons of intlii- pians for a course for analysts on the 

the oppoM„i?ty t^Mf and failures^ , welcome 

syllabus and reading list to suppo^Pth 1 f ° r - shapin & the 

Eduica tfon"©^ °7 ^prT^lDS^r ecomnend ^° r ° f ° Tra * " * "^anr ^ 

Depu?fD?iec?orLr?i?emg gener Mh^ P ^ ^ 

and the Product EvalJation Staff' Senior Review Panel, 


2. The 
memorandum, 
causes of fa 
that motivat 
performance . 
the record ( 
the changes 
analysts to 
problems, es 
revol u t i onar 
pol icy by pr 


primary objective of the course, as I read vn.ir 
is to use the CIA record to illuminate the 3 
ilure and the requirements for success--in a wav 
es ana ysts to improve their on-the-job y 

In other words, the course will elicit from 
^ estimates and good esUma?™.) 
in attitudes an <j practices that will prepare 
deal more effectively with tough Intelligence 
pecially anticipation of military attack* 
y overthrow of key regimes, and sharp shifts in 
esent and potential adversaries. 8 ' ts ,n 7 ’lOO 


25X 


SECRET 
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SUBJECT: Intelligence Successes and Failures (ISF): 

Status Report on Syllabus & Reading List 


25X1 


3. The Tentative Syllabus for Intelligence Successes 
and Failures (ISF) contains a list of specific course 
objectives and sketches out 36 hours of seminars, exercises, 
and guest speakers to illustrate the planned thrust of the 
course (Attachment A). 


4. The selection of reading material s for ISF is still 
in an early stage. The annotated preliminary list of case 
studies and conrcnentar i es by veteran practitioners and 
outside critics provides a general view of the range of 
materials under consideration for the course (Attachment B). 

5. Subject to final approval, I plan to offer the 
course in January and April 1984--to test its effectiveness 
in achieving your objectives. In response to the DDI’s 
recommendation, I am also incorporating the essence of ISF, 
as a two-hour unit, in other OTE courses. This already has 
been done for the current running of the Analysis Training 
Course (DI Career Trainees), the New Analyst Course 
(recently-hired DI analysts), and Introduction to the DI (DO 
Career Trainees). Additionally, I will, in May 1984, 
prepare a memorandum for you and the DDI on the implications 
for management and training of my research findings and 
instructional experience regarding intelligence successes 
and failures. The final goal is to fine tune the ISF course 
and the two-hour unit for regular presentation by OTE 
starting in July 1984. 
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